Skip to main content

Downloads

[Spark Cyclone](https://github.com/XpressAI/Spark Cyclone) provides a set of plugins for Apache Spark that leverage VEs to accelerate Dataframe and SQL processing.

See the getting-started guide for more details.

Release v1.0.0

Hardware Requirements:

The plugin is tested on the following architectures:

VE Architecture: SX-Aurora TSUBASA Vector Engine Type x

Software Requirements:

Apache Spark 3.1.0

Apache Hadoop 3.3.0

Python 3.6+, Scala 2.12, Java 8

For officially supported OSes and kernel versions, please visit NEC's page.

Release Notes

New functionality and performance improvements for this release include:

  • Enabling Spark queries to run on the vector engine.

For a detailed list of changes, please refer to the CHANGELOG.